Claims 

WHAT IS CLAIMED IS: 

1 1 . A computing system having a mass storage devic^and a system timer for 

2 obtaining benchmark timing for a portion of an application program execution, the computing 

3 system comprising: 

4 a mass storage system; 

5 an init module for determining if the timestamp/data is to be collected during the 

6 operation of the application program; 

7 a performance marker module for obtaining and storing the timestamp data for later 

8 retrieval; / 

9 an uninit module for formatting and storing the obtained timestamp data into a data file 

10 within the mass storage device that permits retrieval after the termination of the application 

1 1 program; and 

12 a performance benchmark data post' processing module for determining the benchmark 

13 timing from two or more timestamp data. entries; 

14 wherein the performance marke/ module is executed at predefined points within a 

15 plurality of processing modules withinJthe application program. 



/ 

1 2. The system according to claim 1, wherein: 

2 the init module is executed before any .timestamp data is collected; 

3 the performance marker module is executed each time benchmark timestamp data 

/ 

/ 

4 and overhead timestamp data is to b/collected; 

/ 

5 the uninit module is executed after all timestamp data desired has been collected 

6 to store the timestamp data within records of a Raw Data Table; and 
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7 the perfotjjjl^ce benchmark data post processing mofjl^determines the 

i 

8 benchmark timing from the records stored within the Raw Data Table. 

1 3, The computing system according to claim^, wherein the init module determines if 

2 timestamp data is to be collected. 

1 4. The computing system according to claim 3, wherein init module makes the 

/ 

2 determination that timestamp data is to be collected by checking for the existence of an 

3 identification key within a system registry; 

4 the identification key uniquely identifies the' processing modules to be used to collect, 

5 format, and store the run-time internal state data to be collected. 

/ 

1 5. The computing system according to claim 4, wherein the performance marker 

2 module collects timestamp data only if the init^module has determined that the timestamp data is 

3 to be collected. 



1 6. The computing system according to claim 5, wherein the performance marker 

i 

2 module generates a data record within the l^aw Data Table each time the performance marker 

3 module is executed. 



1 7. The computing system according to claim 6, wherein the benchmark data record 

/ 

2 further containing an overhead timestamp data value each time the performance marker module is 

3 executed. 



1 8. The computing system according to claim 7, wherein the performance marker 

I 

2 module stores the benchmark data records within a data memory block within the processing 

3 modules identified by an identification key within a system registry. 
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ijlj^g system according to claim 8, wherei^l^ i 



1 9. The comp^Kg system according to claim 8, wherei^Bc uninit module retrieves 

2 the data records from the data memory block for transfer to^the Raw Data Table on the mass 

3 storage device. 

1 10. The computing system according to clai^i 9, wherein the performance benchmark 

2 data post processing module determines the benchmark timing from difference between two 

/ 

3 benchmark timestamp data entries stored within the Raw Data Table to generate a second data 

4 Record within a Processed Data Table, 

1 11. The computing system according to fclaim 10, wherein the data record within the 

2 Raw Data Table comprises a ResultID field, an AppID field, a MarkerlD field, a Marker Cycles 

3 Field, and an Overhead Cycles field. 



1 12. The computing system according to claim 1 1 , wherein the second data record of 

f 

2 the Processed Data Field comprises a ResultID field, a Reboot Iteration field, a Launch Iteration 

3 field, a Marker Iteration field, a Marker Pair ID field, and a Seconds Field. 



1 13. The computing system according to claim 12, wherein the ResultID field of the 

,1 

2 Raw Data Table corresponds to the ResultID field in the Processed Data Table. 



3 14. The computing system according to claim 12, wherein the Marker Pair ID field 

/ 

4 corresponds to a second Marker Pair ID field in a Marker Pair Table. 

5 15. The computing system according to claim 14, wherein the Marker Pair Table 

6 comprises the second Marker Pair ID lidd, a start App ID field, a start Marker ID field, an End 

7 App ID field, an End Marker ID field, and a MarkerPair Name field. 



1 1 6. A method for obtaining benchmark pming for a portion of an application program 

2 execution, the method comprising: 
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3 inserting one or nH^Fcode markers into the applicatij^ prognBRt predefined locations 

4 within the appHcation program corresponding to the point a|' which benchmark timing data is 

5 desired; 

6 determining if benchmark timing data is to be collected at each code marker by checking 

7 for the existence of processing modules identified by sif identification key within a system 
registry; 

if benchmark timing data is to be collected at/each code marker: 

JO generating a benchmark data record containing the collected benchmark timing 

1 1^ data each time the code markers are reached; 

12 storing the benchmark data records within a data memory block within the 

13 processing modules identified by the identification key within the system registry; 

14 retrieving the benchmark data records from the data memory block for transfer to 

1 5 first data record in a Raw Data Table qevice once all of the run-time internal state data has 

16 been collected; and 

17 processing the first data records stored within the Raw Data Table to generate 

1 8 second data records in a Processed ©ata Table that estimate the benchmark timing defined 

1 9 between two benchmark data recoras. 



/ 

1 17. The method according to claim 16, wherein4he benchmark timing generated and 

/ 

2 Stored within the processed data table is determined from difference between two benchmark 

/ 

3 timestamp data entries stored within the raw data table. 

/ 

1 18. The method according to claim 17, wherem 



2 the benchmark timing is determined by subtracting an estimate for the total overhead 

/ 
/ 

3 processing from the difference between two benchmark timestamp data entries stored within the 



4 raw data table; 
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■ fHPR)tal overhead processing is determined BfRot 



5 the estimate for fHPf)tal overhead processing is determined olRotaUng the difference 

6 between an overhead timestamp value and a benchmark timestamp value for all code markers 

7 between the two benchmark timestamp entries used to determine the benchmark timing; 

8 the benchmark timestamp value is obtained from a system timer immediately after a code 

9 marker is reached; and 

10 the overhead timestamp value is obtained from the system timer immediately before the 

/ 

1 1 processing returns to the application program from performance marker processing. 



1 .1 9. The method according to claim 18, wherein the first data record within the Raw 

2 Data Table comprises a ResultID field, an AgpID field, a MarkerlD field, a Marker Cycles Field, 

3 and an Overhead Cycles field. 



1 20. The method system according to claifn 19, wherein the second data record of the 



2 Processed Data Field comprises a ResultID field^a Reboot Iteration field, a Launch Iteration 

3 field, a Marker Iteration field, a Marker Pair IDyfield, and a Seconds Field. 



/ 

1 21 . The method according to claim 22, wherein'ihe ResultID field of the Raw Data 

/ 
/ 

2 Table corresponds to the ResultID field in the Processed Data Table. 

/ 

3 22. The method according to claim 2 1 , wherein the Marker Pair ID field corresponds 

/ 

4 to a second Marker Pair ID field in a Marker Pair Table. 



5 23. The method according to claim 22, wherein the Marker Pair Table comprises the 

/ 

6 second Marker Pair ID fieldf a start App ID field, a start Marker ID field, an End App ID field, an 

/ 

1 End Marker ID fi eld, and a MarkerPair Name field. 
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1 24. A compulBirata product readable by a computing sy9^m and encoding a 

I 

2 computer program of instructions for executing a computer process for obtaining run-time 



I, 



internal state data within an application program, said 



inserting one or more code markers into the application program at predefined locations 



computer process comprising: 



oint at which benchmark timing data is 



5 within the application program corresponding to the 

6 desired; 

7 determining if benchmark timing data is to Ije collected at each code marker by checking 

8 for a processing modules identified by an identification key within a system registry; 

if benchmark fiming data is to be collected |at each code marker: 

I 

generating a benchmark data record containing the collected benchmark timing 



data each time the code markers are reached; 

storing the benchmark data records within a data memory block within the 
processing modules idenfified by the identification key within the system registry; 

retrieving the benchmark data records fi*om the data memory block for transfer to 
first data record in a Raw Data Table dcMice once all of the run-time internal state data has 
been collected; and 

processing the first data records stored within the Raw Data Table to generate second data 

18 records in a Processed Data Table that estimate the benchmark timing defined between two 

1 9 benchmark data records; 

20 wherein the benchmark timing generated and stored within the processed data table is 

21 determined fi-om difference between two data ( ntries stored within the raw data table. 



1 25. The computer data product according to^daim 24, wherein the benchmark timing 

2 is determined by subtracting an estimate for the^otal overhead processing from the difference 



between two benchmark timestamp data entries stored within the raw data table; 
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t^lll^tal overhead processing-^is determined ^ij^ii 



4 the estimate for tlH»tal overhead processing-^is determined oPPTtaHng the difference 

5 between an overhead timestamp value and a benchmkrk timestamp value for all code markers 

6 ^ between the two benchmark timestamp entries usedf to determine the benchmark timing; 

7 the benchmark timestamp value is obtainec| from a system timer immediately after a code 

8 marker is reached; and 

9 the overhead timestamp value is obtainedlfrom the system timer immediately before the 
10 processing returns to the application program from performance marker processing. 



1' 26. The computer data product according to claim 25, wherein the first data record 

/ 

2 within the Raw Data Table comprises a ResultID field, an AppID field, a MarkerlD field, a 



3 Marker Cycles Field, and an Overhead Cycles field 



1 27. The computer data product system according to claim 26, wherein the second data 

I 

2 record of the Processed Data Field comprises a ResultID field, a Reboot Iteration field, a Launch 

/ 

3 Iteration field, a Marker Iteration field, a Marker Pair ID field, and a Seconds Field. 



1 28. The computer data product according to claim 27, wherein the ResultID field of 

f 

2 the Raw Data Table corresponds to the ResultID field in the Processed Data Table. 



1 29. The computer data product according to claim 28, wherein the Marker Pair ID 

I 

2 field corresponds to a second Marker Pair ID field in a Marker Pair Table. 

i, 

I 

1 30. The computer data product according to claim 29, wherein the Marker Pair Table 

2 comprises the second Marker Pair ID field, a start App ID fisld, a start Marker ID field, an End 

3 App ID field, an End Marker ID field] and a MarkerPair Name field. 
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3 1 . The compH^data product according to claim 23, whoWh the computer data 



2 product comprises a computer readable storage medium readable by a computer upon which 



3 encoded instructions used to implement the jomputer process are stored. 
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